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PREFACE 


This  report  documents  a  portion  of  the  results  of  a  study  called  "Utility  Analysis  of 
High-Resolution  Multispectral  Imagery"  performed  by  the  Electro-Optical  Science 
Laboratory  of  the  Environmental  Research  Institute  of  Michigan,  Ann  Arbor,  Michigan,  for 
the  Air  Force  ASC/REFQ  during  the  period  January  1994  through  May  1995.  This  study 
was  performed  under  Delivery  Order  57  within  the  Infrared  Information  Analysis  Center 
(IRIA)  program,  contract  number  DLA900-88-D-0392,  for  which  the  Defense  Electronic 
Supply  Center  (DESC),  Dayton,  Ohio,  serves  as  the  contracting  agency.  The  ASC 
program  manager  was  Doug  Amlin.  The  ERIM  program  manager  was  Michael  T. 
Eismaim.  The  authors  of  this  report  are  Michael  T.  Eismann  and  Stephen  D.  Ingle. 
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1.0  INTRODUCTION 


The  Image  Based  Sensor  Model  (IBSM)  is  a  modular  set  of  numerical  tools  for 
designing,  evaluating,  and  modeling  electro-optical  and  infrared  (EO/IR)  imaging  sensors. 
The  primary  motivation  which  led  to  the  development  of  IBSM  was  the  need  for  a  model 
which  (a)  could  produce  simulated  sensor  imagery  in  addition  to  sensor  performance 
metrics  to  better  characterize  the  imaging  performance  of  a  sensor  system,  and  (b)  provides 
the  flexibility  to  evaluate  and  compare  sensors  and  imaging  configurations  with  differing 
characteristics  without  rewriting  computer  code. 

To  satisfy  the  first  need,  IBSM  is  primarily  geared  to  image  simulation;  that  is,  it 
can  generate  renditions  of  high  fidelity  input  scenes  which  are  representative  of  actual 
sensor  imagery,  including  a  wide  range  of  atmospheric,  sensor,  and  processing  effects.  In 
addition  to  this  image-in,  image-out  mode  of  operation,  the  model  also  contains  tools  for 
parametrically  computing  sensor  performance  metrics  such  as  signal-to-noise  ratio  (SNR), 
ground  sample  distance  (GSD),  ground  resolved  distance  (GRD),  and  image  quality  as 
defined  by  the  National  Image  Interpretability  Rating  Scale  (NIIRS).  The  combination  of 
these  two  operating  modes  provides  the  user  the  means  for  evaluating  the  level  of  synergy 
between  subjective  imaging  performance  to  quantitative  sensor  performance  metrics. 

To  satisfy  the  second  need,  IBSM  was  designed  to  be  completely  modular  in  that 
each  effect  modeled  is  done  so  as  a  self-contained  function.  This  provides  the  user  with  a 
set  of  modeling  building  blocks  which  can  be  tied  together  in  a  wide  variety  of  ways  to 
easily  model  almost  any  sensor  design  or  imaging  configuration.  Each  module  contains  its 
own  graphical  user  interface  (GUI)  for  simple  entry  of  the  defining  module  parameters. 

The  modular  design  philosophy  also  has  the  advantage  that  it  easily  accommodates 
upgrades  to  extend  it  to  sensing  and  processing  effects  not  currently  covered.  This  simply 
involves  the  generation  of  a  new  building  block  as  opposed  to  a  full  model  revision.  As  an 
example,  the  current  model  does  not  contain  tools  for  synthetic  scene  generation,  but  such  a 
capability  could  be  added  without  impacting  the  remainder  of  the  model. 

This  report  overviews  the  IBSM  model,  including  a  brief  overview  (section  2), 
detailed  description  (section  3),  usage  overview  (section  4),  example  models  (section  5), 
and  software  overview  (section  6). 
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2.0  MODEL  OVERVIEW 


2.1  MODELING  APPROACH 

IBSM  consists  of  an  extensive  set  of  discrete  modeling  tools  which  can  be  tied 
together  to  evaluate  the  performance  of  a  wide  variety  of  sensors.  IBSM  was  primarily 
intended  to  be  used  in  an  image  simulation  mode  as  depicted  in  Figure  2-1 .  Such  a 
simulation  begins  with  a  high  fidelity  input  image  representing  the  target  and/or  background 
scene  to  be  simulated.  The  image  is  then  degraded  through  a  series  of  operations 
characterizing  the  intervening  atmosphere,  the  sensor  optics,  the  electro-optical  detector, 
and  subsequent  signal  processing  (although  no  such  effects  have  been  implemented  yet). 
Various  utilities  for  image  format  conversion,  image/spatial  spectrum  conversion,  metric 
computation,  and  image  display  also  exist. 

A  parametric  modeling  capability  is  also  supported  by  IBSM,  specifically  for 
computing  image  quality.  This  is  depicted  in  Figure  2-2.  As  opposed  to  the  image 
simulation  mode,  parametric  modeling  does  not  explicitly  involve  an  image  chain.  Rather, 
sensor  metrics  such  as  the  modulation  transfer  function  (MTF),  signal-to-noise  ratio 
(SNR),  ground  resolved  distance  (GRD),  and  image  quality  (NIIRS)  are  computed  directly 
fixim  sensor  parameters.  This  computation  can  be  performed  iteratively  while  altering  a 
specified  parameter  within  the  loop  to  investigate  performance  as  a  function  of  an  aibitrary 
independent  variable. 

In  general,  the  model  incorporates  multispectral  imagery  (MSI).  In  the  image 
simulation  mode,  MSI  are  explicitly  carried  through  the  image  chain.  Additionally,  the 
center  wavelengths  and  spectral  bandwidths  of  each  band  are  earned  through  the  chain  such 
that  wavelength  dependent  modules  operate  differently  on  the  image  bands.  Within  each 
band,  however,  a  narrowband  assumption  is  usually  made.  That  is,  the  band  center 
wavelength  defines  the  spectral  dependence.  The  parametric  modeling  tools,  however, 
explicitly  integrate  over  the  sensor  bandwidth. 

Most  modules  are  also  based  on  a  linear,  space  invariant  assumption.  For  example, 
many  effects  arc  characterized  by  an  optical  transfer  function  (OTF)  which  operates  on  the 
spatial  Fourier  transform  of  an  image.  Nonlinear  and  space  variant  effects,  however,  arc 
not  necessarily  incompatible  with  the  basic  model  formulation. 
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LOOP  OVER  INDEPENDENT  VARIABLE 


2.2  MODELING  ENVIRONMENT 


IBSM  was  designed  and  implemented  to  operate  as  a  set  of  toolboxes  within  the 
Khoros  1.05  Cantata  environment.  Cantata  is  an  image  and  signal  processing  prototyping 
environment  which  is  widely  used  throughout  the  government  and  university  research 
communities.  What  Cantata  provides  is  the  flexible  modeling  environment  and  graphical 
user  interface  (GUI)  which  makes  IBSM  relatively  easy  to  use.  In  addition,  Cantata 
provides  a  large  set  of  standard  image  and  signal  processing  and  display  utilities  which  are 
at  the  user's  disposal. 

The  IBSM  software  consists  of  several  functional  layers  of  code  written  in  the  C 
programming  language.  The  executive  layer  was  written  using  the  Khoros  development 
system,  and  includes  all  the  Khoros-specific  functions,  including  file  I/O  and  graphical  user 
interface.  The  Khoros  library  function  layer  consists  of  the  interface  between  the  Khoros 
executive  code  and  the  sensor  modeling  library,  which  contains  the  fundamental  modeling 
routines.  The  sensor  modeling  library  is  a  set  of  C  subroutines  which  has  been  written 
independent  of  Khoros  or  any  other  executive  code.  Numerical  Recipes  and  MODTRAN 
are  used  for  analytical  computations  and  atmospheric  modeling. 

2.3  CAPABILITIES  SUMMARY 

IBSM  currently  consists  of  five  toolboxes:  IBSM  Atmosphere,  IBSM  Optics, 

IBSM  Detector,  IBSM  Performance,  and  IBSM  Utilities.  Each  of  these  toolboxes  are 
briefly  described  here.  A  more  detailed  description  is  given  in  Section  3. 

The  IBSM  Atmosphere  toolbox  contains  the  tools  for  simulating  image  propagation 
along  the  atmospheric  path  between  the  imaged  area  and  the  sensor,  including  atmospheric 
path  transmission  and  radiance,  long  path  turbulence,  and  aero-optical  boundary  layer 
turbulence.  Atmospheric  path  transmission  and  radiance  effects  are  computed  by  executing 
MODTRAN.  A  separate  module  was  written  to  provide  a  graphical  user  interface  to 
MODTRAN  and  allow  simplified  entry  of  all  the  defining  atmospheric  parameters. 

The  IBSM  Optics  toolbox  contains  the  tools  for  characterizing  the  image  effects  of 
an  optical  sensor  system.  These  effects  are  primarily  modeled  as  optical  transfer  functions 
(OTFs)  and,  therefore,  generally  operate  on  a  spatial  spectrum  (Fourier  transform  of  an 
image)  rather  than  the  image  itself.  OTFs  are  included  for  aperture  diffraction,  defocus. 
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wavefront  irregularity,  line-of-sight  drift,  and  line-of-sight  jitter.  Modules  for 
incorporating  user  defined  OTF  data  in  the  form  of  one-dimensional  and  two-dimensional 
OTFs  or  point  spread  functions  (PSF)  are  also  available.  Finally,  a  radiometric  tool  is 
provided  for  transforming  a  pupil  plane  radiance  image  into  a  focal  plane  irradiance  image, 
including  stray  radiance  sources. 

The  IBSM  Detector  toolbox  contains  the  tools  for  characterizing  the  electro-optical 
detection  process  at  the  focal  plane.  Once  again,  several  of  the  effects  are  modeled  as 
OTFs,  including  that  due  to  the  finite  detector  element  size,  the  time-delay-integrate  (TDI) 
process,  charge  transfer  inefficiency,  and  carrier  diffusion.  Conversion  of  the  focal  plane 
irradiance  image  to  a  sampled  electronic  image  is  performed  by  the  combination  of  a 
photoelectronic  detection  and  sampling  tool.  The  non-ideal  performance  of  the  detector  can 
be  characterized  by  noise,  quantization,  and  nonuniformity  modules. 

The  IBSM  Performance  toolbox  contains  the  modules  written  primarily  for 
parametric  sensor  modeling.  This  includes  modules  for  generating  atmospheric  and  sensor 
spectral  profiles;  computing  MTF  from  an  OTF  chain;  computing  SNR,  GRD,  and/or 
NIIRS  directly  from  sensor  parameters;  computing  line  response  functions,  SNR,  and 
NIIRS  from  an  image;  and  configuring  a  sensor  for  proper  exposure  control. 

The  IBSM  Utilities  toolbox  contains  routines  for  file  format  conversion  and  also  for 
transforming  images  into  spatial  spectra,  and  vice  versa. 
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3.0  DETAILED  DESCRIPTION 


This  section  contains  a  detailed  description  of  the  physical  basis  of  the  IBSM 
toolboxes.  Before  proceeding,  however,  some  common  nomenclature  will  be  defined. 

For  routines  which  operate  on  radiance  imagery,  Lin(x,y)  and  Lout(x,y)  will  represent  the 
image  radiance  as  a  function  of  spatial  coordinates  x  and  y.  Analogous  notation  will  be 
used  for  reflectance  imagery  p(x,y),  temperature  imagery  T(x,y),  irradiance  imagery 
E(x,y),  and  imagery  in  detected  photoelectron  units  N(x,y).  The  spatial  coordinates  are 
generally  specified  in  angular  (radian)  units  unless  otherwise  noted. 

Optical  transfer  functions  are  characterized  by  H(u,v)  and  operate  on  spatial  spectra 
Gin(u,v)  to  form  Gout(u,v)  such  that 

Gou,  =  Hiu,v)  Gi„  (m,v)  (3-1) 

where  u,v  are  spatial  frequency  (rad‘0  dimensions.  In  general,  the  OTF  and  the  spatial 
spectra  are  complex  (real  and  imaginary)  two-dimensional  distributions.  The  units  of 
G(u,v)  are  generally  arbitrary  and  H(u,v)  is  dimensionless. 

In  the  case  of  multiband  images  or  spatial  spectra,  the  basic  functions  outlined  in 
this  section  operate  separately  on  each  band.  This  is  implied  in  the  descriptions  to  follow, 
particularly  where  the  operations  are  wavelength  dependent.  Each  image  band  is 
characterized  by  its  center  wavelength  Xq  and  spectral  bandwidth  AX,. 

3.1  IBSM  ATMOSPHERE 

3.1.1  MODTRAN  Input 

This  function  provides  a  user  interface  for  generating  a  MODTRAN  path  data  file  as 
an  input  to  IBSM  functions  that  execute  MODTRAN,  including  Path  Trans/Rad,  Create 
Spectra,  and  Create  Radiance  Image.  The  output  file  is  in  ASCII  format,  as  given  in  Table 
3-1. 


The  user  is  referred  to  the  applicable  MODTRAN  documents  [1,2]  for  an  overview 
of  the  model  inputs.  A  few  comments  regarding  commonly  used  defaults  and  overrides  are 
given  here.  The  visibility  is  determined  from  the  haze  model  if  a  zero  value  is  entered. 


9 


Table  3- 1 ;  Format  of  MODTRAN  Path  Data  File 


MODEL 

integer 

Model  atmosphere  (1-6) 

MULT 

integer 

Multiple  scattering  (0  =  off,  1  =  on) 

TBOUND 

float 

Surface  temperature  (K,  0.0  =  first  layer  temp.) 

SALE 

float 

Surface  albedo  (0-1,  -1,  -2,  -3,  -4,  -5,  -6) 

IHAZE 

integer 

Aerosol  haze  model  (0-6,  8-10) 

ICLD 

integer 

Cloud  model  (0-10, 18-20) 

VIS 

float 

Visibility  (km,  0.0  =  default) 

RAINRT 

float 

Rain  rate  (mm/hr) 

GNDALT 

float 

Ground  altitude  (km) 

IDAY 

integer 

Day  of  the  year  (1-365) 

ISOURC 

integer 

Celestial  source  (0  =  sun,  1  =  moon) 

ANGLEM 

float 

Moon  phase  angle  (deg) 

HI 

float 

Target  altitude  (km) 

H2 

float 

Sensor  altitude  (km) 

ANGLE 

float 

Sensor  zenith  angle  from  target  (deg) 

PARMl 

float 

Sun  azimuth  angle  from  sensor  LOS  (deg) 

PARM2 

float 

Sun  zenith  angle  from  target  (deg) 

rvi 

integer 

Minimum  wavenumber  (cm‘1) 

IV2 

integer 

Maximum  wavenumber  (cm'l) 

IDV 

integer 

Wavenumber  sampling  (cm'l) 

IFWHM 

integer 

Wavenumber  resolution  (cm'l) 
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otherwise  it  is  overridden  by  the  user  entry.  The  surface  albedo  can  be  explicitly  entered 
(assumed  spectrally  flat),  or  determined  from  one  of  the  spectral  profiles  which  exist. 
Finally,  the  target  zenith  angle  is  reaUy  measured  from  zenith  (MODTRAN  definition)  such 
that  -180°  is  a  downlooking  sensor. 

All  modules  which  are  based  on  MODTRAN  require  a  path  data  file  as  an  input. 

The  module  forms  the  TAPES  input  file,  executes  MODTRAN  Gocation  defined  by 
MODTRAN  envirorunent  variable),  and  extracts  the  desired  data  from  the  generated  TAPE6 
or  TAPE?  files.  The  MODTRAN  DIRAC  file  must  be  in  the  directory  firom  which  BSM 
was  executed,  along  with  the  reft?}^  file  for  using  spectral  albedo  models. 

3.1.2  Path  Trans/Rad 

This  function  applies  the  effects  of  atmospheric  path  transmission  and  radiance 
globally  to  an  input  radiance  image.  This  is  performed  in  two  steps.  First,  the  atmospheric 
transmission  x(X)  and  path  radiance  Lpath  (^)  ss  a  function  of  wavelength  are  computed  by 
MODTRAN  based  on  the  path  data  file  created  by  the  Modtran  Input  function.  Then,  the 
band-average  transmission  and  path  radiance  is  applied  to  the  image 

^  ijL  AA 

It  is  imperative  that  the  wavelength  limits  specified  in  the  MODTRAN  path  data  file  cover 
each  spectral  band  specified  in  the  input  image  header.  Spatial  scale  factors  in  the  input 
image  are  ignored. 

3.1.3  Turbulence  OTF 

This  function  applies  the  effects  of  long  path  atmospheric  turbulence  to  an  image.  It 
is  characterized  as  an  OTF  and,  therefore,  operates  in  the  spatial  spectrum  domain.  The 
OTF  is  given  by  [3] 


H(m,v)  =  ’  (3-3) 

where  D  is  the  effective  aperture  diameter. 
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P  =  Vm^  + 


(3-4) 


and  ro  is  the  correlation  diameter  defined  by  Fried  [4,  5]. 

The  correlation  diameter  can  be  either  user  specified  or  computed  from  an  index 
stmcture  parameter  model  along  the  line-of-sight  path.  In  the  latter  case  [6] 


To  =2.1 


5.84 


L 


/  ^5/3 

'  h-h^  ' 


-1-3/5 


dh 


cos^  •’*1  "  ^ 

where  hi  is  the  target  altitude,  h2  is  the  sensor  altitude,  <()  is  the  target  nadir  angle,  and 
Cn^(h)  is  the  vertical  index  structure  parameter  distribution. 


(3-5) 


Three  Cn^(h)  models  are  implemented,  all  of  which  are  parametrized  by  the  index 
structure  parameter  at  h  =  1  meter.  This  generally  ranges  from  lO-^^  m  representing 
fairly  turbulent  conditions  to  lO^'*  m-2/3  representing  fairly  benign  conditions  [7].  The  first 
model  is  a  simple  model  [6] 


C(*)  = 


C^{h  =  \m)  h<\m 
C^{h=^\m)  h>\m 


(3-6) 


The  second  is  a  model  proposed  by  Hufnagel  [8]  for  medium  to  high  altitudes,  and  is 
extended  to  lower  altitudes  using  a  power  coefficient  to  match  the  specified  Cn^(h)  at  h  =  1 
m  [6],  The  functional  form  is 


C(A)  = 


C;{h  =  \m)h 


C„\h  =  \m) 

ri5.85+togC,2(*=lm) 

[  3 


-t-lTxlO-'V 


,-16  _-/i/1500 


h<\m 

\m<h<  \km 
h  >  Ikm 


(3-7) 


where  v  is  the  upper  atmospheric  wind  speed  (generally  in  the  18-36  m/s  range).  The  final 
model  is  an  approach  based  on  empirical  data  [9] 
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{h  =  Im) 

h<lm 

(h  =  l/n)/j'^^ 

h  <  10/n 

■0.1C„^(/i  =  lm)ft-®“ 

h  <  \km 

3.16C/(/i  =  lm)/i""' 

h  <  20km 

0 

h  >  20km 

(3-8) 


Figures  3-1  to  3-3  illustrate  the  index  structure  parameter  models  for  a  range  of 
conditions:  benign  (Cn^  =  lO'i'*  at  h  =  1  m),  moderate  (Cn^  =  lO'^^  m‘2/3  at  h  =  1 
m),  and  turbulent  (Cn^  =10-12  m-2/3  at  h  =  1  m).  For  the  Hufnagel  model,  upper 
atmosphere  wind  speeds  of  18, 27,  and  36  m/s  were  used,  respectively. 

The  a  parameter  in  Eq.  (3-3)  specifies  whether  the  OTF  is  of  the  long  exposure  (a 
=  0)  or  short  exposure  (a  =  0.5)  variety.  This  is  determined  by  the  temporal  nature  of  the 
turbulence  relative  to  the  sensor  integration  time.  In  general,  the  OTF  is  modeled  as  a  mix 
of  the  long  exposure  Hl  (u,v)  and  short  exposure  Hs  (u,v)  OTFs  given  by 

H{u,v)  =  H^{u,v)e  °  +  H^^u,v){\-e  '*  ")  (3-9) 

where  Tj  is  the  pixel  dwell  (or  integration  time)  and  V  is  the  effective  velocity  of  the 
atmosphere  relative  to  the  sensor  pupil  plane  axes. 


Spatial  (rad'i  units)  and  spectral  scaling  information  must  be  available  in  the  input 
file  header,  and  the  data  must  correspond  to  a  spatial  spectrum,  which  can  be  produced 
from  an  image  using  the  Transform  tool. 


3.1.4  Aero-Optic  OTF 

This  function  applies  the  effects  of  boundary  layer  aero-optical  turbulence  to  an 
image.  It  is  characterized  by  an  OTF  and,  therefore,  operates  in  the  spatial  spectrum 
domain.  The  OTF  is  given  by  [10] 


l-e 


V 


H{u,v)  =  e 


(3-10) 
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Figure  3-3;  Empirical  Index  Structure  Parameter  Model 
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where  is  the  turbulence-induced  wavefront  phase  variance  and  L*,  Ly  are  the  spatial 
correlation  lengths  of  the  turbulent  boundary  layer. 

The  phase  variance  is  given  by 

=  (3-11) 

where  G  is  the  Gladstone-Dale  coefficient  (0.22  x  m^/kg),  p'  is  the  rms  density 
fluctuation,  Lz  is  the  correlation  length  of  the  boundary  layer  in  the  normal  direction,  and 
tbi  is  the  boundary  layer  thickness. 

The  model  is  based  on  a  "rule-of-thumb"  equation  for  the  rms  density  fluctuation 
and  correlation  lengths  [11].  Specifically, 

p'  =  0.2[p„-p]  (3-12) 


where. 


P=  3 

^  l-i-r(y-l)M^/2 

(3-13) 

Po  is  the  free  stream  air  density,  r  =  0.89,  y  =  1.4,  and  M  is  the  Mach  number  (v/305  m/s). 
The  correlation  lengths  ate  approximated  by 

4=0.4  4, 

(3-14) 

II 

II 

p 

(3-15) 

The  boundary  layer  is  then  specified  by  its  thickness  tbi  along  with  the  free  stream  air 
density  and  platform  velocity.  Table  3-2  provides  a  typical  free  stream  air  density  as  a 
function  of  altitude. 

Spatial  (rad'^  units)  and  spectral  scaling  information  must  be  available  in  the  input 
file  header,  and  the  data  must  correspond  to  a  spatial  spectrum,  which  can  be  produced 
from  an  image  using  the  Transform  tool. 
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Table  3-2:  Typical  Free  Stream  Air  Density  as  a 
Function  of  Attitude 


Altitude  nani 


Air  Density  (Tcg/m^) 


1  1.0 

2  0.9 


5 


0.7 


10 


0.4 


12 

15 

20 


0.3 

0.2 

0.1 
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3.2  IBSM  OPTICS 


3.2.1  Diffraction  OTF 


This  function  applies  the  effects  of  aperture  diffraction  to  an  image.  It  is 
characterized  by  an  OTF  and,  therefore,  operates  in  the  spatial  spectrum  domain.  For  an 
unobscuted  circular  aperture  [12] 


Hiu,v)  = 


f 


cos 


-I 


ypo)  Po 


1- 


f4 

<Poj 


P^Po 

P>Po 


(3-16) 


where  p  is  defined  by  Eq.  (3-4)  and 


Po 


D 


Ao 


where  D  is  the  effective  aperture  diameter.  For  a  rectangular  aperture  [12] 


mu,v) 


where  dx,  dy  are  the  aperture  widths  in  their  respective  directions  and 


A(^)  = 


I^I>1 


(3-17) 


(3-18) 


(3-19) 


In  the  case  of  an  obscuration,  only  the  circular  symmetric  case  is  modeled 
(obscuration  input  is  ignored  for  rectangular  aperture).  In  this  case,  the  OTF  is  given  by 
[13] 

=  (3-20) 

1-T 
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A= 


cos 


\Po 


.p^ 

Po^ 


1- 


f4 

<.PoJ 


P^Po 

P>Po 


(3-21) 


B= 


2t]^ 


n 


r  ^  \ 


cos 


y^Poj 


VPo 


\VPoJ 


0 


P^lPo 

P>VPo 


(3-22) 


C  =  \ 


-Irf 
2  \ 


n 


1C 


<t> 


2(1-’)’),  -,[ 

—2 - ^tan 

'(i+v] 

tanf 

'1)1 

71 

( 

,2jJ 

0 


l-T] 

p<— P. 


1-^  ^  ^1  +  ^ 
— p.Sp<— p. 


1-1-77 

p>— P. 


(3-23) 


0  =  COS 


l-fT7^-(2p/po)^ 

277 


(3-24) 


p  is  defined  in  Eq.  (3-4),  po  =  D/Xo,  and  Tj  is  the  relative  obscuration  (ratio  of  obscuration 
to  aperUu’e  diameters). 

Spatial  (rad’i  units)  and  spectral  scaling  information  must  be  available  in  the  input 
file  header,  and  the  data  must  correspond  to  a  spatial  spectrum,  which  can  be  produced 
from  an  image  using  the  Transform  tool. 

3.2.2  Defocus  OTF 


This  function  applies  the  effects  of  optics  defocus  or  blur  to  an  image.  It  is 
characterized  by  an  OTF  and,  therefore,  operates  in  the  spatial  spectrum  domain.  The 
defocus  (or  blur)  function  is  modeled  as  a  gaussian  distribution  for  which  the  1/e  blur 
radius  in  angular  space  is  specified  independently  for  the  x  and  y  axes.  Mathematically 
[14] 
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(3-25) 


This  function  applies  the  effects  of  wideband  (with  respect  to  the  sensor  integration 
time)  jitter  of  the  optical  sensor  line-of-sight  to  an  image.  It  is  characterized  by  an  OTF 
and,  therefore,  operates  in  the  spatial  spectrum  domain.  By  virtue  of  the  wideband 
assumption,  the  jitter  is  modeled  as  a  zero  mean,  gaussian  random  process  resulting  in  the 
gaussian  expected  value  for  the  OTF  [15]; 


H{u,v)  =  e 


(3-28) 


where  o,  and  Gy  are  the  rms  jitter  amplitudes  in  thek  corresponding  angular  directions. 


21 


Spatial  (rad'i  units)  scaling  information  must  be  available  in  the  input  file  header, 
and  the  data  must  correspond  to  a  spatial  spectrum,  which  can  be  produced  from  an  image 
using  the  Transform  tool. 

3.2.4  Drift  OTF 

This  function  applies  the  effects  of  constant  angular  drift  of  a  sensor  line-of-sight  to 
an  image.  It  is  characterized  by  an  OTF  and,  therefore,  operates  in  the  spatial  spectrum 
domain.  The  OTF  is  defined  by 


H{u,v)= sinc(fl,u)sinc(ay  v) 


(3-29) 


where 


.  sin(7r^) 

smc(^)  =  — (3-3C 

7t^ 

and  a,  and  ay  are  the  angular  drift  magnitudes  over  the  sensor  integration  time  in  their 
corresponding  directions. 

Spatial  (rad‘1  units)  scaling  information  must  be  available  in  the  input  file  header, 
and  the  data  must  correspond  to  a  spatial  spectrum,  which  can  be  produced  from  an  image 
using  the  Transform  tool. 

3 .2.5  Wavefront  OTF 

This  function  applies  the  effects  of  a  spatially  random  wavefront  error  to  an  image. 
It  is  characterized  by  an  OTF  and,  therefore,  operates  in  the  spatial  spectrum  domain.  The 
OTF  is  given  by  [16] 


Hiu,v)  =  e 


\-€ 


V 


(3-31) 


where  the  wavefront  error  is  defined  in  the  sensor  pupil  plane  by  the  phase  variance 
and  X  and  y  correlation  lengths  L*  and  Ly  (defined  in  spatial  aperture  dimensions).  The 
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phase  variance  is  specified  by  an  rms  wavefront  error  (waves)  at  a  reference  wavelength 
and  scaled  to  the  image  band  center  wavelength(s)  in  inverse  proportion  to  the  wavelength. 

Spatial  (rad'i  units)  and  spectral  scaling  information  must  be  available  in  the  input 
file  header,  and  the  data  must  correspond  to  a  spatial  spectrum,  which  can  be  produced 
from  an  image  using  the  Transform  tool. 

3.2.6  UserOTF(l-D) 

This  function  applies  an  OTF  specified  by  one-dimensional  user  data  to  an  image. 
As  it  is  an  OTF,  it  operates  in  the  spatial  spectrum  domain.  The  data  is  contained  in  an 
ASCn  file  in  formats  accommodating  real  and  complex  data  specified  in  radial  form 
(radial),  with  separability  in  the  x  and  y  axes  (x  and  y),  or  with  separability  and  similarity 
in  the  X  and  y  directions  (x  or  y).  The  user  data  is  interpolated  using  linear  or  spline 
techniques  to  the  input  spatial  frequency  grid  prior  to  forming  the  2-D  OTF. 

The  various  file  formats  characterizing  the  user  OTF  are  given  in  Table  3-3.  In  the 
case  of  radial  data,  the  OTF  is  interpolated  onto  the  (u,v)  grid  at  each  point  relative  to  its 
radius  defined  by  Eq.  (3-4).  For  x  and  y  data,  the  input  data  is  interpolated  onto  two 
functions  Hx(u)  and  Hy(v),  and  the  two-dimensional  OTF  is  defined  by 

H{u,v)  =  H^(u)H^iv)  (3-32) 

For  X  or  y  data,  Hx(u)  and  Hy(v)  are  identical  by  definition.  Spatial  (rad*^  units)  scaling 
information  must  be  available  in  the  input  file  header,  and  the  data  must  correspond  to  a 
spatial  spectrum,  which  can  be  produced  from  an  image  using  the  Transform  tool. 

3.2.7  User  OTF  (2-D) 

This  function  applies  an  OTF  specified  by  two-dimensional  user  data  to  an  image. 
As  it  is  an  OTF,  it  operates  in  the  spatial  spectrum  domain.  The  user  data  containing 
scaling  information  is  contained  in  an  image  file.  This  data  can  correspond  to  an  OTF  (rad' 
*  scaling  information)  or  a  point  spread  function  (PSF,  rad  scaling  information). 
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Table  3-3:  User  OTF(l-D)  File  Formats 

SF(1)  OTFreal(l)  [OTFimagd)] 

•  • 

•  • 

•  • 

SF(N)  OTFreal(N)  [OTFimag(N)] 

(a)  Radial  Data 

OTFreal(l)  [OTFimagd)] 

OTFreal(N)  [OTFimag(N)] 

(b)  X  and  Y  Data 

[OTFx,imagd)]  SFyd)  OTFY,reald)  [OTFy.imagd)] 

[OTFx,imag(N)]  SFy(N)  OFFy^ealCN)  [OTFY,imag(N)] 

(c)  X  or  Y  Data 

[]  =  data  element  exist  only  for  complex  data 
N  lines  of  space  delimited  data  in  all  cases 
SF  =  Spatial  Frequency  (rad'd 
OTF  =  Optical  Transfer  Function 


SFxd)  OTFx,reald) 


SFx(N)  OTFx,real(N) 


SFd) 


SF(N) 
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In  the  case  of  OTF  data,  the  user  defined  data  is  interpolated  onto  the  input  spatial 
frequency  grid  using  a  bilinear  technique.  In  the  case  of  PSF  data,  the  user  OTF  is 
computed  at  each  grid  point  by 


1 


H{u,v)  =  ^tthii,j)e 
2k  '=1 M 


~i2;r(x,tt+y,v 


(3-33) 


where  xi  and  yj  are  the  angular  positions  corresponding  to  the  PSF  indices.  If  specified, 
the  OTF  data  is  normalized  to  unity  at  zero  spatial  frequency  in  either  case. 

Spatial  (rad'i  units)  scaling  information  must  be  available  in  the  input  file  header, 
and  the  data  must  correspond  to  a  spatial  spectmm,  which  can  be  produced  using  the 
Transform  tool. 


3.2.8  Radiometry 


This  function  performs  a  radiometric  conversion  of  an  effective  pupil  plane  radiance 
image  to  a  focal  plane  irradiance  image,  including  the  sensor  throughput,  thermal  radiation 
of  the  optical  chain,  and  stray  radiance: 


E{x,y)  =  [T^opMx^y)  +  ^op,EBB{^’T^p,)E^  +  4 


(3-34) 


where  (f/#)  is  the  effective  sensor  F-number,  x  is  the  optical  train  transmission  including 
obscuration,  Eopt  is  the  optical  train  effective  emissivity,  Topt  is  the  optical  train  effective 
temperature,  Ls  is  the  in-band  stray  radiance  (non-thermal),  and  Lbb  is  a  blackbody  spectral 
radiance  function 


Ebb{^'E)  — 


2hc^  1 

^5 


(3-35) 


Spectral  scaling  information  must  be  available  in  the  input  file  header,  and  the  image 
data  must  be  in  W/m^sr  units.  The  output  image  data  is  in  W/m^  units. 
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3.3  IBSM  DETECTOR 


3.3.1  Detector  Size  OTF 


This  function  applies  the  effects  of  the  finite  detector  width  to  an  image.  It  is 
characterized  by  an  OTF  and,  therefore,  operates  in  the  spatial  spectrum  domain.  The 
detector  is  assumed  to  have  rectangular  form,  which  generates  an  OTF  with  a  sine 
distribution  [17].  It  is  extended,  however,  to  include  pixel  aggregation  effects; 


H(u,v)  =  sine 


f 


sine 


.  /  , 


N,-l  Ny-l 

Z  Z  cos  (j):  I 

,=0  j=0 


(3-36) 


where  Wx  and  Wy  are  the  detector  sizes  in  x  and  y,  f  is  the  optical  system  focal  length,  Nx 
and  Ny  are  the  number  of  aggregated  pixels  in  x  and  y. 


<i>ij  =  2^ 


iPyV 

f 


(A'.-i)p.u  (w.-iKy 

2/  2/ 


(3-37) 


and  Px  and  py  are  the  detector  center-to-center  spacings  (pitch)  in  x  and  y.  The  summation 
in  Eq.  (3-36)  results  from  the  sum  of  aggregated  detector  elements,  with  a  phase  shift 
corresponding  to  the  relative  spacing  between  elements  in  the  image  domain. 

Spatial  (rad'i  units)  scaling  information  must  be  available  in  the  input  file  header, 
and  the  data  must  correspond  to  a  spatial  spectrum,  which  can  be  produced  from  an  image 
using  the  Transform  tool. 

3.3.2  TDIOTF 


This  function  applies  the  effects  of  time-delay-integration  (TDI)  to  an  image.  It  is 
characterized  by  an  OTF  and,  therefore,  operates  in  the  spatial  spectrum  domain.  The  TDI 
can  occur  in  either  the  x  or  y  directions,  and  may  exhibit  a  mismatch  between  the  TDI 
clocking  rate  and  the  image  motion  rate.  The  OTF  is  given  by: 


H(u,v)  =  sine 


dw 

7p. 


N„rN 


N  ■  N 

^^tdi  phases 


tdi  phase 

z 

7=0 


,  -T  d(P-l)  . 


(3-38) 
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where  w  is  the  spatial  frequency  in  the  TDI  direction  (u  or  v),  d  is  the  detector  width  in  the 
TDI  direction,  f  is  the  optical  system  focal  length,  Ntdi  is  the  number  of  TDI  stages, 

Nphases  is  the  number  of  clock  phases  per  transfer,  and  p  is  the  ratio  of  the  TDI  clocking 
rate  to  image  motion  rate.  The  sine  function  results  due  to  the  image  motion  over  each  TDI 
stage,  while  the  summation  results  from  the  relative  shifts  between  TDI  stage  images  which 
arises  due  to  the  rate  mismatch. 

Spatial  (rad'^  units)  scaling  information  must  be  available  in  the  input  file  header, 
and  the  data  must  correspond  to  a  spatial  spectmm,  which  can  be  produced  fi’om  an  image 
using  the  TransfoTvi  tool. 

3.3.3  CTEOTF 

This  function  applies  the  effects  of  charge  transfer  inefficiency  of  a  charge  coupled 
device  (CCD)  detector  array  readout  to  an  image.  It  is  characterized  by  an  OTF  and, 
therefore,  operates  in  the  spatial  spectrum  domain.  The  OTF  is  given  by  [18] 

H(u  v)  =  ^9) 

where  N*  and  Ny  are  the  number  of  transfers  in  x  and  y,  Px  and  py  are  the  center-to-center 
detector  spacings  (pitch)  in  x  and  y,  f  is  the  optical  system  focal  length,  Nphase  is  the 
number  of  clock  phases  per  transfer,  and  e  is  the  charge  transfer  efficiency  (per  phase). 

Spatial  (rad*^  units)  scaling  information  must  be  available  in  the  input  file  header, 
and  the  data  must  correspond  to  a  spatial  spectrum,  which  can  be  produced  from  an  image 
using  the  Transform  tool. 

3.3.4  Diffusion  OTF 

This  function  applies  the  effects  of  minority  carrier  diffusion  in  a  charge  coupled 
device  (CCD)  sensor  to  an  image.  It  is  characterized  by  an  OTF  and,  therefore,  operates  in 
the  spatial  spectrum  domain.  The  OTF  is  given  by  [19] 
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-oALD 


H{u,v) 


1  +  aAL[p) 

^-aALD 

\  +  aALO 


(3-40) 


where 


AL{p)  = 


1 

1 

4 

^2np^ 

AW- 

1  /  J 

(3-41) 


p  is  given  by  Eq.  (3-4),  a  is  the  carrier  spectral  diffusion  coefficient,  ALD  is  the  depletion 
layer  width,  ALO  is  the  diffusion  length,  and  f  is  the  optical  system  focal  length.  Table  3-4 
provides  the  carrier  spectral  diffusion  coefficient  for  silicon  at  various  wavelengths. 

Spatial  (rad"i  units)  scaling  information  must  be  available  in  the  input  file  header, 
and  the  data  must  correspond  to  a  spatial  spectrum,  which  can  be  produced  from  an  image 
using  the  Transform  tool. 

3.3.5  Detection 


This  function  performs  a  photoelectronic  conversion  of  a  focal  plane  irradiance 
image  to  a  detected  photoelectron  image,  including  detector  sensitivity,  aggregation,  dark 
current,  and  saturation.  The  conversion  process  is  given  by 


nT,NTDiN,NyWpVyE{x,y)  + 


(3-42) 


where  T)  is  the  quantum  efficiency,  Tj  is  the  pixel  dwell  time,  Ntdi  is  the  number  of  TDl 
stages,  Nx  and  Ny  are  the  number  of  aggregated  pixels  in  x  and  y,  Wx  and  Wy  are  the 
detector  widths  in  x  and  y,  Jd  is  the  dark  current  density,  h  is  Planck's  constant,  c  is  the 
speed  of  light  in  a  vacuum,  and  q  is  the  electronic  charge. 

Spectral  scaling  information  must  be  available  in  the  input  file  header,  and  the  image 
data  must  be  in  W/m^  units.  The  output  image  data  is  in  units  of  photoelectron  counts. 
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Table  3-4:  Carrier  Spectral  Diffusion  Coefficient  for 
Silicon  at  Various  Wavelengths 

Wavftlpnpth  tuml  Coefficient  (min-^) 


0.40 

5000 

0.45 

1800 

0.50 

1000 

0.55 

650 

0.60 

450 

0.65 

300 

0.70 

200 

0.75 

150 

0.80 

95 

0.85 

60 

0.90 

35 

0.95 

20 

1.00 

10 
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3.3.6  Noise 


This  function  adds  a  random  noise  process  to  an  input  image.  Two  types  of  noise 
are  modeled.  The  first  is  signal  dependent,  Poisson  distributed  shot  noise,  which  can  be 
either  enabled  or  disabled.  The  second  is  signal  independent,  additive  noise  that  is 
assumed  zero  mean,  gaussian  distributed  with  a  specified  variance.  The  noise  sources  are 
assumed  both  jointly  and  pixel-to-pixel  independent.  The  input  and  output  image  data  must 
be  in  photoelectron  units. 

The  input  image  data  must  be  in  photoelectron  units.  The  output  image  units  are  the 

same. 


3.3.7  Quantization 

This  function  quantizes  a  detected  photoelectron  image  through  a  scalar  roundoff 
process.  Mathematically, 


N  -N  ■ 

max  min 


N(x.y)<N^^ 

ff{x.y)>N, 


■  +  \\N.^^N(x.y)<N, 


(3-43) 


where  Nmin  and  N^ax  are  the  minimum  and  maximum  input  levels  of  the  quantizer  and  b  is 
the  number  of  digitization  levels  (bits). 

The  input  image  data  scaling  is  arbitrary,  but  consistent  with  the  minimum  and  maximum 
levels. 


3.3.8  SampUng 

This  function  samples  an  input  image  on  a  rectilinear  grid  with  arbitrary  spacing. 
The  sample  locations  in  angular  (radian)  units  are  given  by 

^  =  +  (3-44) 
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(3-45) 


y  =  }'min+(y  +  ^y)y 

where  px  and  py  are  the  detector  center-to-center  spacings  in  x  and  y,  f  is  the  optical  system 
focal  length,  5x  and  6y  are  the  user  defined  relative  offset  of  the  sampling  grid  in  x  and  y 
(relative  to  pitch),  Xmin  and  ymin  are  the  minimum  field  angles  of  the  input  image,  and  i  and 
j  are  indices  which  range  from  zero  to  the  maximum  values  such  that  the  angular  sample 
locations  do  not  exceed  the  input  image  maximum  field  angles  x^ax  and  ymax-  The 
resampling  process  is  achieved  using  a  bilinear  interpolation  of  the  input  image  data. 

Spatial  (rad  units)  scaling  information  must  be  available  in  the  input  file  header. 

The  output  image  scaling  information  will  vary  depending  on  the  sampling  parameters. 

3.3.9  Nonuniformity 

This  function  applies  the  effects  of  random  detector  gain  and/or  offset 
nonuniformity  to  an  input  image.  The  nonuniformity  can  be  characterized  as  an 
independent  random  variable  between  image  samples,  or  the  spatial  correlation 
characteristics  can  be  specified  by  an  input  autocorrelation  image  file.  In  both  cases, 
realizations  of  gaussian  distributed  random  gain  and  offset  patterns  are  generated 
(independent  random  sample  for  each  input  image  pixel).  The  gain  pattern  G(x,y)  is  unity 
mean  with  a  standard  deviation  given  by  the  gain  nonuniformity  and  the  offset  pattern 
0(x,y)  is  zero  mean  with  a  standard  deviation  given  by  the  offset  nonuniformity  times  the 
maximum  signal  level. 

When  a  spatial  autocorrelation  file  is  given,  it  is  first  resampled  into  a  convolution 
kernel  with  an  x  and  y  sample  spacing  identical  to  the  input  image.  This  is  performed  by  a 
bilinear  interpolation.  Next,  it  is  normalized  to  exhibit  unit  variance.  Finally,  the  gain  and 
offset  patterns  are  convolved  by  it  to  generate  the  desired  spatial  correlation  characteristics. 

Once  the  appropriate  random  gain  and  offset  patterns  are  generated,  the  output 
image  is  computed  by 


hut{x,y)  =  G{x,y)l^{x,y)  +  0(x,y)  (3-46) 
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The  units  of  the  input  image  are  arbitrary,  but  must  correspond  to  the  specified  maximum 
signal  level  for  proper  scaling  of  the  offset  nonuniformity.  Spatial  scaling  information 
must  exist  in  the  input  and  autocorrelation  file  headers  when  an  autocorrelation  file  is  used. 
The  units  are  arbitrary,  but  must  be  consistent. 

3.4  IBSM  PERFORMANCE 

3.4.1  Create  Spectra 

This  function  generates  an  eight-band  IBSM  file  containing  atmospheric  and  sensor 
spectral  distributions.  The  bands  contain,  respectively,  (0)  atmospheric  path  transmission, 
(1)  atmospheric  path  radiance,  (2)  irradiance  at  the  target  for  a  direct  source,  (3)  diffuse 
downwelling  radiance  at  the  target,  (4)  target  reflectance,  (5)  background  reflectance,  (6) 
sensor  optical  chain  transmission,  and  (7)  detector  quantum  efficiency.  All  are  in  single 
row  format  of  "nwavl"  columns.  When  the  override  parameters  are  not  selected,  the  first 
four  distributions  (0-3)  are  computed  via  MODTRAN  in  reference  to  the  ASCII  path  data 
file,  the  following  two  (4-5)  from  the  ASCII  reflectance  file  data,  and  the  final  two  (6-7) 
from  the  ASCII  sensor  file  data.  In  all  cases,  the  spectral  distributions  are  computed 
through  a  linear  interpolation  of  the  data,  and  can  be  overridden  with  the  spectrally  flat 
override  parameters.  The  minimum  and  maximum  x  parameters  in  the  IBSM  header 
contain  the  wavelength  minimum  and  maximum  in  meters.  The  minimum  y,  maximum  y, 
center  wavelengths,  and  spectral  bandwidths  contained  in  the  header  should  be  ignored. 
This  generated  IBSM  file  is  of  a  form  suitable  for  input  to  the  Sensor  Performance 
function. 

3.4.2  Create  MTF 

This  function  generates  a  one-dimensional  Modulation  Transfer  Function  (MTF) 
based  on  a  real- valued  two-dimensional  spatial  spectrum  file  representing  the  MTF.  The 
generated  MTF  can  lie  along  either  the  X  or  Y  axes  of  the  input  data,  and  is  placed  as  a 
single  row  in  an  IBSM  output  file.  The  frequency  scale  (min/max)  can  be  either  the  same 
as  the  input  (automatic)  or  overridden  (fixed).  In  the  latter  case,  the  data  is  linearly 
interpolated  to  the  specified  grid.  This  generated  IBSM  file  is  of  a  form  suitable  for  input 
to  the  Sensor  Performance  function. 
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3.4.3  Sensor  Performance 


This  function  computes  metrics  characterizing  sensor  performance  (including  SNR, 
GRD,  and  NIIRS)  based  on  a  set  of  sensor  parameters;  target,  background,  atmosphere, 
and  sensor  spectral  distributions  using  the  Create  Spectra  function;  and  x  and  y  axis  MTF 
functions  using  the  Create  MTF  function.  The  metric  is  written  to  an  ASCII  file  along  with 
an  arbitrary  independent  variable.  Depending  on  the  "update"  parameter,  the  file  is 
initialized  before  writing  or  the  data  is  appended  to  an  existing  file.  In  the  long  form  output 
data  format,  the  full  input  parameter  set  is  written  to  the  file  upon  initialization  (update  =  0), 
and  the  metric  data  is  augmented  with  additional  intermediate  computation  results.  The 
short  form  output  data  format  results  in  a  two  column  ASCII  file  containing  the 
independent  variable  and  computed  metric  for  each  update  execution,  which  is  useful  for 
generating  parametric  plot  data. 


The  Signal  to  Noise  Ratio  (SNR)  metric  refers  to  the  target  to  background  detected 
signal  difference  relative  to  the  noise  level.  It  is  computed  by: 


SNR  = 


^LOW 


J.NNwwT, 


Nh,+- 


■+a,  + 


1 

I2L  2”-!  . 


(3-47) 


where 


(3-48) 

^ LOW  ~ 

(3-49) 

4hc{f/#f 


^stray 


'‘'max 

J 


dl 


(3-50) 
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/t 


and  Lbb  (^)T)  is  the  blackbody  function  given  in  Eq.  (3-35).  The  parameters  used  in  Eqs. 
(3-47)  to  (3-53)  are  defined  in  Table  3-5. 


The  SNR  computation  also  includes  saturation  effects  and  optionally  automatic  gain 
control.  Saturation  is  incorporated  by  limiting  Nhi  and  Nlow  to  within  the  minimum  to 
maximum  range.  Automatic  gain  control  is  performed  by  reducing  both  Nhi  and  Nlow  by 
a  factor  such  that  Nhi  equals  a  specified  AGC  level.  If  Nhi  is  less  than  this  AGC  level 
initially,  no  scaling  is  performed. 

The  Ground  Resolved  Distance  (GRD)  metric  is  computed  orthogonal  to  the  sensor 
line-of-sight  axis.  Initially,  it  is  computed  in  both  the  x  and  y  axes  by 

=max  (3-54) 

lUr  f  . 


where  R  is  the  sensor  to  target  slant  range,  px  and  py  are  the  detector  center-to-center 
spacings  in  x  and  y,  f  is  the  optical  system  focal  length,  and  Ur  is  the  highest  spatial 
frequency  to  satisfy 

MTF,  («)>—  (3-55) 

The  final  GRD  is  given  as  the  geometric  mean  (square  root  of  the  product)  of  the  GRD  in  x 
and  y. 
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Table  3-5:  SNR  Performance  Parameter  Definitions 


Ldifiuse  (^) 

Ediiect  (^) 

4 

Ptgt  (^)>  Pbkg  (^) 
Ttgt>  Tbkg 
L|gt  (^)>  Lbkg  (^) 
Lpath  (^) 

Xatm  Q") 

Xopt  (^) 

Eopt 

Topt 

TjfX) 

Lstray 

Td 

NtdI 

m 

Nx,Ny 
Wx,Wy 
Nmin,  Nmax 

b 

On 

Jd 

Ntgt,  Nbkg 


Diffuse  downwelling  radiance  (W/m^sr) 
Direct  source  irradiance  (W/m^) 

Source  zenith  angle  (deg) 

Target,  background  reflectance 
Target,  background  temperature  (Kelvin) 
Target,  background  radiance  (W/m^sr) 
Atmospheric  path  radiance  (W/m^sr) 
Atmospheric  path  transmission 
Optical  train  transmission 
Effective  optics  emissivity 
Effective  optics  temperature  (Kelvin) 
Detector  quantum  efficiency 
In-band  stray  radiance  (W/m^sr) 

I>well  time  (msec) 

Time  -  delay  -  integrate  stages 
Optics  F-number 
Aggregation  in  x  and  y 
Detector  width  in  x  and  y  (iim) 

Quantizer  minimum  and  maximum 
Quantizer  digitization  levels 
Detector  rms  noise  (electrons) 

Detector  dark  current  density  (p,A(cm2) 
Target,  background  signal  level  (electrons) 
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Image  quality  is  specified  by  a  National  Image  Interpretability  Rating  Scale  (NIIRS) 
value.  This  is  computed  from  the  SNR  and  modulation  transfer  functions  in  x  and  y  by  the 
Generalized  Image  Quality  Equation  [20]: 

Q  =  1 1.81+3.32  logio  (RER  /  GSD)  -  1.48H -  (3-56) 

SNR 

where 


II 

(3-57) 

RER  =  ^RER^RERy 

(3-58) 

GSD  =  ^GSDfiSD^ 

(3-59) 

max  ER  (^  =  1.0  m  3.0)  monotonic 

H  ,=  { 

ER  (1.25)  not  monotonic 

(3-60) 

fi£R.,,=£R„(0.5)-£R,,(-0.5) 

(3-61) 

GSD  = 

'  / 

(3-62) 

ER  (|)  =  0.5+' 

;rJo  yv  y  f  ) 

dw  (3-63) 

The  parameters  used  in  Eqs.  (3-56)  to  (3-63)  are  given  in  Table  3-6.  NIIRS  is  generally 
specified  in  reflective  bands  for  a  target  reflectance  of  0.15  and  background  reflectance  of 
0.07,  and  in  thermal  bands  for  blackbody  radiance  with  a  target  temperature  of  302K  and 
background  temperature  of  300K. 

3.4.4  Exposure  Control 

This  function  performs  exposure  control  by  determining  the  pixel  dwell  time,  TDl 
stages,  and  aggregation  levels  which  place  the  maximum  of  the  target  and  background 
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Table  3-6:  NIIRS  Performance  Parameter  Definitions 


Pixel  position 

Px,y 

Detector  pixel  pitch  (pm) 

Nx,y 

Aggregation  in  x  and  y 

w 

Spatial  frequency  (rad'l)  in  x  or  y 

f 

Optical  system  focal  length  (cm) 

D 

Aperture  diameter  (cm) 

^min 

Minimum  wavelength  (pm) 

ERx,y(^) 

Line  response  function  in  x  and  y 

R 

Target  to  sensor  slant  range  (km) 

GSDx,y 

Ground  sample  distance  in  x  and  y 

RERx.y 

Relative  edge  response  in  x  and  y 

Hx.y 

Edge  height  overshoot  in  x  and  y 

SNR 

Signal  to  noise  ratio 

G 

SNR  gain  due  to  image  processing 

RER 

Relative  edge  response  (mean) 

H 

Edge  height  overshoot  (mean) 

GSD 

Ground  sample  distance  (mean) 

Q 

Image  quality  (NIIRS) 
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signal  levels  between  specified  minimum  and  maximum  levels.  For  the  signal 
computation,  sensor  spectral  distributions  using  the  Create  Spectra  function  are  used.  The 
signal  computation  is  given  by  Equations  (3-50)  to  (3-53). 

Initially,  the  signal  level  is  computed  for  a  user  defined  desired  dwell  time,  the 
maximum  allowable  TDI,  and  the  minimum  allowable  aggregation.  If  the  maximum  of  the 
target  and  background  signal  level  (called  initial  signal)  falls  between  the  minimum  to 
maximum  signal  window,  the  initial  sensor  configuration  values  are  unchanged. 

If  the  initial  signal  exceeds  the  maximum  (saturation  condition),  first  the  TDI  stages 
are  decremented  by  steps.  Once  the  adjusted  signal  level  falls  below  the  maximum,  the 
process  stops  with  a  new  number  of  TDI  stages  having  been  established.  If  the  saturation 
condition  cannot  be  resolved  with  the  minimum  allowable  TDI,  the  dwell  time  is  reduced  to 
place  the  adjusted  signal  to  the  maximum  level  with  the  minimum  allowable  TDI  stages. 

If  the  initial  signal  is  less  than  the  minimum  level  (low  signal  condition),  first  the 
aggregation  levels  are  incremented  (alternately  x  and  y)  by  steps.  Once  the  adjusted  signal 
level  falls  above  the  minimum,  the  process  stops  with  the  new  aggregation  levels  having 
been  established.  If  the  low  signal  condition  cannot  be  resolved  with  the  maximum 
aggregation,  the  dwell  time  is  increased  to  place  the  adjusted  signal  to  the  minimum  level 
with  the  maximum  aggregation. 

The  output  consists  of  the  sensor  configuration  values,  which  are  placed  in  a  five- 
band  floating-point  VIFF  file  (one  value  per  band)  in  the  following  order:  (0)  pixel  dwell 
time  in  msec,  (1)  TDI  stages,  (2)  X  aggregation,  (3)  Y  aggregation,  (4)  adjusted  signal 
level.  The  values  can  be  extracted  to  global  variables  using  the  Extract  VIFF  Data  function. 

3.4.5  Image  Quality 

This  function  computes  image  quality  metrics  including  line  response  functions, 
GSD,  SNR,  and  NIIRS  from  an  image  containing  test  patterns  and/or  edge  features.  The 
user  specifies  the  locations,  in  angular  (mrad)  units,  of  horizontal  and  vertical  edges  as  well 
as  ideally  uniform  image  regions  for  noise  estimation. 

First,  the  function  extracts,  centers,  and  normalizes  the  vertical  and  horizontal  edge 
response  functions.  The  image  is  assumed  to  exhibit  the  proper  sampling  characteristics 


38 


such  that  these  will  correspond  to  ERx,y  (0  in  Eq.  (3-63)  where  ^  corresponds  to  image 
pixels.  Next,  the  mean  and  variance  over  designated  target  and  background  regions  is 
computed.  Finally,  the  image  quality  metrics  are  computed  via  Equations  (3-56)  through 
(3-62)  along  with 


SNR  =  -^  (3-64) 

^max 

where  A|i  is  the  difference  between  the  mean  signal  levels  and  Gmax  is  the  standard 
deviation  associated  with  the  region  exhibiting  a  higher  mean  signal. 

Based  on  user  options,  the  function  output  consists  of  the  two  edge  response 
functions  in  two  column  ASCII  format  and  an  ASCII  metric  summary  file.  Scaling 
information  (rad  units)  must  exist  in  the  input  image  file  header,  and  the  specified  edge  and 
region  locations  must  fall  within  the  angular  range  of  the  image. 

3.5  IBSM  UTILITIES 

3.5.1  VIFFtoIBSM 

This  function  adds  header  information  to  the  comment  field  of  a  VIFF  file  to  create 
an  IBSM  format  output.  The  spatial  scaling  and  spectral  band  data  can  either  be  entered 
from  the  screen  (up  to  four  bands),  or  input  from  an  ASCII  header  file.  The  header  file 
format,  displayed  in  Table  3-7,  corresponds  to  that  generated  using  the  IBSM  Info 
function. 

3.5.2  mSMInfo 

This  function  generates  an  ASCII  file  containing  information  extracted  from  the 
mSM  header  (comment  field  in  VIFF  file).  This  includes  data  type,  image  size,  number  of 
bands,  spatial  scaling,  and  the  center  wavelength  and  spectral  bandwidth  for  each  band. 
The  header  file  format,  displayed  in  Table  3-7,  is  appropriate  for  input  to  the  VIFF  to 
IBSM  utility. 
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Table  3-7:  IBSM  Header  File  Format 


File  Name:  fhame 

File  Type:  EBSM  Khoros  image  file  format 

VIFF  Information: 

Data  Type:  data-type 

X_Pixels:  x _pixels 

Y_Pixels:  y _pixels 

Bands:  bands 

IBSM  Information: 

X_Min:  x_min 

X_Max:  x_max 

Y_Min:  y_min 

Y_Max:  y_max 

Wavelengths  Bandwid.th§ 

wavelength  (1)  bandwidth  (1) 

wavelength  (bands)  bandwidth  (bands) 
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3.5.3  Transform 


This  function  performs  conversions  between  the  image  and  spatial  spectrum 
domains  through  a  discrete  Fourier  transform.  The  forward  and  reverse  transformations 
are  given  by  [21] 


ilK^aXj+vyi^^ 


1  iV,-l  , 

I(x,y)  = -  2  2  G{uj,vAe 

N  N  >=o  *=0  '  ' 


—ilfC^xuj+yVi; ) 


(3-65) 

(3-66) 


where  I(x,y)  is  an  image,  G(u,v)  is  the  corresponding  spatial  spectrum,  (x,y)  are  angular 
coordinates  (rad),  (y,v)  are  angular  spatial  frequency  coordinates  (rad'^),  and  Nx  and  Ny 
are  the  transform  sizes  in  x  and  y. 


For  computational  efficiency,  the  transforms  are  performed  using  a  Fast  Fourier 
Transform  (FFT)  algorithm.  The  use  of  this  algorithm  places  some  constraints  on  the 
transform  size  sampling.  The  transform  sizes  must  be  a  power  of  two  in  x  and  y.  If  the 
image  or  spectrum  to  be  transformed  is  not  an  exact  power  of  two  in  size,  a  larger 
transform  size  must  be  used.  The  input  image  or  spectrum  is  automatically  zero  padded  to 
this  size.  The  sampling  of  the  transform  is  also  automatically  computed  based  on  the 
sample  spacing  of  the  input.  Specifically, 
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for  the  forward  transform  case  where  the  image  scale  factors  (xmin,  Xmax.  ymin»  ymax) 
correspond  to  after  the  zero  padding  operation.  Note  that  the  transform  is  always 
essentially  centered,  which  is  accomplished  by  quadrant  swapping  prior  to  and  after  the 
FFT. 


Spatial  scaling  information  must  be  available  in  the  input  file  header,  although  the 
image  data  units  are  arbitrary.  Both  complex  and  real  input  and  output  data  types  are 
supported. 

3.5.4  Create  Plot  Data 

This  function  extracts  a  row  or  column  of  an  IBSM  file  and  outputs  it  along  with 
spatial  scaling  data  into  two  column  ASCII  format  for  plotting. 

3.5.5  Create  Radiance  Image 

This  function  converts  a  ground  reflectance  and,  optionally,  temperature 
distribution  into  a  radiance  image,  including  both  reflected  and  radiated  components.  The 
reflected  component  uses  only  the  reflectance  image  input  (assumed  Lambertian)  with  direct 
and  diffuse  illumination  computed  via  MODTRAN  in  reference  to  the  ASCII  path  data  file. 
This  file  can  be  generated  using  the  MODTRAN  Input  tool.  It  is  important  that  the 
wavelength  limits  specified  in  the  MODTRAN  path  data  file  cover  each  spectral  band 
specified  in  the  input  image  header.  The  direct,  diffuse,  or  both  illumination  values  from 
MODTRAN  can  be  overridden.  The  radiated  component  is  computed  using  both  the 
reflectance  and  temperature  (Kelvin  units)  images,  and  is  ignored  when  the  latter  does  not 
exist. 


Mathematically,  the  output  image  is  given  by 


I{x,y)  =  p{x,y) 


7t 


(3-71) 


+  [l-p{x,y)]L,,l^,T{x,y)] 


where  p(x,y)  is  the  reflectance  image,  T(x,y)  is  the  temperature  image,  Edirect  (^)  is  the 
directional  illumination,  (|)d  is  the  zenith  angle  of  the  directional  source,  Ldiffuse  (^)  is  the 
diffuse  downwelling  radiance,  and  Ak  is  the  spectral  bandwidth  for  the  band  of  interest. 
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Spectral  scaling  information  must  be  available  in  the  reflectance  input  file  header, 
and  the  data  must  be  in  reflectance  units.  The  temperature  input  file  data  must  be  in  units  of 
absolute  temperature  (Kelvin).  The  output  image  data  is  in  radiance  (W/m^sr)  units. 

3.5.6  Ground/Angle  Transform 

This  function  performs  a  coordinate  transformation  of  a  radiance  image  between  the 
horizontal  ground  plane  (meter  units)  and  line-of-sight  angular  (radian  units)  coordinates. 
Only  the  image  header  scaling  values  are  altered  based  on  the  viewing  geometry.  The 
defined  azimuth  axis  is  the  non-squinted  asix  (normal  to  the  line-of-sight  and  vertical  axes). 
The  scaling  of  the  squinted  axis  is  based  on  a  linear  projection,  which  occurs  under  the 
assumption  that  the  ground  field-of-view  in  the  squinted  direction  is  much  smaller  than  the 
slant  range.  No  image  distortion  or  perspective  effects  are  modeled. 

If  the  input  image  is  scaled  in  meter  units  in  the  viewing  plane  (orthogonal  to  line- 
of-sight)  rather  than  the  horizontal  plane,  this  utility  can  be  used  with  a  zenith  angle  of  zero 
to  convert  to  angular  units. 

Spatial  scaling  information  in  meter  units  must  exist  in  the  input  file  header.  The 
spectral  information  and  image  data  is  arbitrary. 
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4.0  USAGE  OVERVIEW 


In  this  section,  information  is  provided  in  an  effort  to  assist  the  user  in  developing 
and  executing  sensor  models  based  on  the  IBSM  toolbox.  Detailed  information  on  the  use 
of  Khoros  and,  specifically.  Cantata  is  available  elsewhere  [22]  and  is  not  repeated  here. 
However,  brief  descriptions  of  some  commonly  used  features  are  given. 

4.1  FILE  FORMATS 

Image  data,  as  well  as  other  data  at  times,  is  passed  between  BBSM  modules  and 
other  Cantata  glyphs  (Khoros  term  for  functional  module)  by  files  in  the  Khoros 
Visualization/Image  Rle  Format  (VIFF).  The  Khoros  Image  File  Format  is  organized  as 
1024  bytes  of  header  followed  by  map(s),  location  data  and  then  image  data.  The  header 
also  contains  information  identifying  the  header  format  used.  This  file  format  or  data 
structure  has  evolved  from  originally  supporting  only  images  to  supporting  multi¬ 
dimensional  data.  The  multidimensional  aspect  is  used  to  accommodate  multiband 
imagery. 

For  use  with  IBSM,  specific  header  information  relating  to  spatial  scaling  and 
spectral  band  characteristics  is  added  into  a  comment  field  of  the  VIFF  files.  Many  of  the 
EBSM  modules  require  this  information  to  be  present  for  correct  operation.  This  extended 
VIFF  file  format  is  referred  to  as  IBSM  file  format.  The  VIFF  to  IBSM  Utility  is  used  to 
add  this  header  information  to  a  VIFF  file.  Since  the  comment  field  is  essentially 
extraneous  in  the  VIFF  file  format,  IBSM  file  formats  are  compatible  with  all  the  standard 
Khoros  functions  and,  in  most  cases,  the  added  header  data  is  passed  through  undisturbed. 

Table  4-1  summarizes  the  input  file  header  requirements  for  correct  operation  of 
each  IBSM  function.  Table  4-2  summarizes  the  input  and  output  file  types  and  assumed 
units  (if  applicable)  for  each. 

4.2  MODEL  GENERATION 

Cantata  is  a  graphical  programming  environment  for  generating,  in  the  case  of 
IBSM,  sensor  evaluation  models.  Each  of  the  IBSM  functions,  along  with  over  a  hundred 
standard  data  processing  and  visualization  programs  in  the  Khoros  system,  are  represented 
by  icons  (called  glyphs).  To  create  a  model,  the  user  selects  the  desired  glyphs  (and 
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Table  4-1:  Input  File  Header  Requirements  for  IBSM  Functions 


Toolbox 

Function 

Header  Requirements 

Spatial  Scaling 

Center  Wavelengths 

spectral  Bandwidths 

Atmosphere 

Modtran  Input 

no 

no 

no 

Path  Trans/Rad 

no 

yes 

yes 

Turbulence  OTF 

yes  (rad'l) 

yes 

no 

Aero-Optic  OTF 

yes  (rad'l) 

yes 

no 

Optics 

Diffraction 

yes  (rad'l) 

yes 

no 

Defocus  OTF 

yes  (rad'l) 

no 

no 

Jitter  OTF 

yes  (rad'l) 

no 

no 

Drift  OTF 

yes  (rad'l) 

no 

no 

Wavefront  OTF 

yes  (rad‘1) 

yes 

no 

User  OTF  (1-D) 

yes  (rad'l) 

no 

no 

User  OTF  (2-D) 

yes  (rad'*) 

no 

no 

Radiometry 

no 

yes 

yes 

Detector 

Detector  Size  OTF 

yes  (rad'*) 

no 

no 

TDIOTF 

yes  (rad'*) 

no 

no 

GTE  OTF 

yes  (rad'*) 

no 

no 

Diffusion  OTF 

yes  (rad“l) 

no 

no 

Detection 

no 

yes 

no 

Noise 

no 

no 

no 

Quantization 

no 

no 

no 

Sampling 

yes  (rad) 

no 

no 

Nonuniformity 

no 

no 

no 

Performance 

Create  Spectra 

no 

no 

no 

Create  MTF 

yes  (rad"l) 

no 

no 

Sensor  Performance 

yes  (m) 

no 

no 

Exposure  Control 

yes  (m) 

no 

no 

Image  Quality 

yes  (rad) 

no 

no 

Utilities 

VIFFtoIBSM 

no 

no 

no 

IBSM  Info 

yes 

yes 

yes 

Transform 

yes 

no 

no 

Create  Plot  Data 

yes 

no 

no 

Create  Radiance  Imagery 

no 

yes 

yes 

Ground/Angle  Transform 

yes  (m) 

no 

no 
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Table  4-2:  Input  and  Output  File  Types  and  Units  for  IBSM  Functions 
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control  structures,  as  needed),  places  them  in  the  Cantata  workspace,  and  coimects  them  to 
indicate  the  flow  of  the  model.  Such  a  model  is  called  a  workspace.  Workspaces  can  then 
be  executed,  saved,  and  restored  to  be  used  again  or  modified  later.  The  save  and  restore 
features  are  implemented  by  selecting  the  Workspace  button. 

4.3  DATA  AND  IMAGE  VIEWING 

Three  primary  data  and  image  viewing  capabilities  exist  under  Cantata,  all  of  which 
are  selected  under  the  Output  button.  Information  contained  in  ASCII  files  can  be 
displayed  using  the  ASCII  File  Viewer  contained  under  the  Information  heading.  Imagery 
can  be  displayed  in  a  variety  of  ways,  all  contained  under  the  Display  Image  heading. 
Finally,  data  contained  in  ASCII  or  VBFF  files  can  be  plotted  using  the  Xprism  2  Utility 
under  the  Plot  Data  heading.  Plots  are  placed  on  the  display  in  a  default  mode,  but  can  be 
altered  by  the  user  and  output  to  a  printer  or  file. 

4.4  STANDARD  KHOROS  TOOLBOXES 

In  addition  to  the  EBSM  functions  incorporated  under  Khoros,  the  user  can  utilize  a 
broad  range  of  standard  utilities  for  signal  and  image  processing  by  selecting  glyphs  from 
the  standard  toolboxes.  A  brief  overview  is  given  here. 

4.4. 1  Program  Utilities 

This  toolbox  contains  routines  for  flow  control  and  generic  conunands  and 
comments.  The  flow  control  functions  are  useful  particularly  for  looping  (e.g.,  computing 
sensor  performance  as  a  function  of  some  parameter)  and  conditional  branches.  The 
generic  command  allows  the  user  to  insert  an  arbitrary  UNIX  command  line  program 
anywhere  within  a  workspace. 

4.4.2  Input  Sources 

This  toolbox  contains  utilities  for  inserting  supplied  or  user  defined  image  and 
signal  data  files  into  a  workspace,  or  for  creating  images  or  signals.  The  latter  is 
particularly  useful  for  generating  test  patterns  or  uniform  sources  as  inputs  to  sensor 
models. 
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4.4.3  Output 


This  toolbox  contains  image  and  data  display  functions,  and  was  briefly 
overviewed  in  Section  4.3. 

4.4.4  Conversions 

This  toolbox  contains  utilities  for  data  type  and  file  format  conversions.  Data  type 
conversions  include  complex/real  conversions  as  well  as  utilities  for  combining  and 
extracting  bands  into/from  multiband  image  files.  Rle  conversions  are  supported  between 
VIFF  and  raw  files,  as  well  as  a  variety  of  others,  including  TIFF  and  Sun  Raster. 


4.4.5  Arithmetic 

This  toolbox  contains  routines  for  a  range  of  mathematical  image  operations, 
including  unary  operations  (scaling,  offset,  absolute  value,  square  root,  etc.),  binary 
operations  (addition,  subtraction,  etc.),  logical  operations  (And,  Or,  etc.),  and  matrix 
algebra  (inversion,  eigenvalues,  etc.). 

4.4.6  Image  Processing 

This  toolbox  contains  standard  image  processing  functions  including  spatial  filters, 
morphological  operations,  transforms,  frequency  filters,  histograms,  geometric  operations 
(expanding,  shrinking,  transposing,  etc.),  and  subregion  operations  (cropping,  inserting, 
etc.) 

4.4.7  Image  Analysis 

This  toolbox  contains  standard  image  analysis  functions  including  segmentation, 
feature  extraction,  and  classification/clustering  algorithms. 

4.4.8  Signal  Processing 

This  toolbox  contains  standard  signal  processing  functions,  and  parallels  the  image 
processing  toolbox,  but  operates  on  1-D  signals. 
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4.4.9  Remote  and  GIS 


This  toolbox  contains  some  advanced  routines  for  warping,  surface,  and  vector  data 
operations. 

4.5  GLOBAL  VARIABLES 

The  Global  Variables  button  is  used  to  define  variables  and  evaluate  expressions 
within  the  Cantata  environment.  Once  defined,  variables  can  be  used  in  the  place  of 
integer,  float,  and  double  arguments  (GUI  entries)  of  glyphs.  Also,  expressions  can  be 
defined  to  establish  interrelationships  between  variables  (and,  therefore,  model  parameters) 
which  can  be  dynamic  in  the  course  of  a  workspace  or  model  execution. 

For  example,  consider  a  sensor  performance  model  which  loops  over  some 
independent  variable.  It  is  conceivable  that  the  IBSM  modules  in  each  iteration  of  the  loop 
change  dependent  on  the  loop  variable.  This  relationship  is  established  by  representing  the 
EBSM  module  input  as  a  variable  and  defining  the  variable  by  some  functional  dependence 
to  the  loop  variable.  Valid  expressions  for  this  functional  dependence  include  variables, 
standard  arithmetic  operators  and  logicals,  as  well  as  predefined  constants  and  functions. 
Any  string  of  alphanumeric  characters,  beginning  with  a  letter,  may  be  used  as  a  variable. 

In  addition  to  defining  functional  dependencies  between  global  variables  and 
defining  the  glyph  operation  in  terms  of  such  variables,  it  is  also  possible  to  define  a 
dependence  of  a  global  variable  based  on  the  result  of  a  glyph  operation.  This  can  be 
accomplished  using  the  Extract  VIFF  data  utility  under  the  Output/Information  heading, 
which  allows  the  user  to  assign  any  element  of  a  VIFF  file  to  a  global  variable. 

4.6  ON-LINE  DOCUMENTATION 

On-line  documentation  (or  help)  is  provided  by  clicking  on  help  buttons.  The  on¬ 
line  help  pages  that  are  displayed  by  a  particular  help  button  are  appropriate  to  the  location 
of  the  graphical  user  interface  on  which  the  help  button  is  found.  Since  the  Cantata  master 
form  is  at  the  highest  level  of  the  Cantata  GUI  hierarchy,  the  help  button  at  the  upper  right 
hand  comer  of  the  Cantata  master  form  displays  by  default  the  introduction  to  Cantata. 
Notice  the  button  at  the  upper  left  hand  comer  of  the  on-line  help  display  labeled,  "More 
Help  Pages".  This  submenu  button  allows  you  to  display  related  help  pages;  in  this  case. 
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all  the  other  help  pages  for  Cantata,  organized  not  alphabetically  but  in  the  order  in  which 
they  appear  in  the  manual. 

Help  buttons  found  on  each  subform  will  display  help  pages  which  describe  the 
purpose  and  operation  of  that  particular  subform.  Again,  any  other  related  help  pages  may 
be  accessed  by  using  the  submenu  button  labeled,  "More  Help  Pages." 

The  on-Une  documentation  actually  places  the  man  pages  for  a  particular  function 
into  a  user  screen.  In  addition  to  a  description  of  the  function  and  usage,  a  description  of 
the  model  inputs  is  given.  Since  each  function  is  executable  from  a  UNIX  command  line, 
each  input  is  associated  with  a  unique  command  line  switch.  Therefore,  the  various  inputs 
in  the  documentation  are  indicated  by  these  switches.  The  association  with  GUI 
descriptions  is  not  explicitly  given,  but  is  probably  obvious  in  most  cases. 


5.0  EXAMPLE  MODELS 


In  this  section,  example  models  are  described  to  illustrate  the  use  of  the  IBSM 
nKxiules  for  sensor  performance  evaluation.  The  models  are  based  on  a  hypothetical 
^sible  reconnaissance  sensor  which  corresponds  to  a  test  case  for  the  Generalized  Image 
Quality  Equation  (GIQE)  discussed  in  Section  3.4.3. 

5.1  GIQE  TEST 

The  first  example  is  a  comparison  of  parametric  sensor  performance  to  the  test  case 
provided  with  the  GIQE  documentation  [20].  The  imaging  scenario  and  sensor  parameters 
are  summarized  in  Table  5-1 . 

The  Cantata  workspace  corresponding  to  this  test  case  is  illustrated  in  Figure  5-1. 
The  basic  layout  is  as  follows.  There  is  an  upper  line  of  functions  which  generates  spectral 
distributions  of  atmospheric  path  radiance  and  transmission,  diffuse  and  specular 
illumination,  target  and  background  reflectance,  and  sensor  optical  transmission  and 
detector  quantum  efficiency  using  the  MODTRAN  Input  and  Create  Spectra  modules. 
There  is  also  a  lower  line  which  generates  the  x  and  y  system  MTFs  by  passing  a  constant 
unity  image  through  a  series  of  OTFs  and  then  using  the  Create  MTF  module  to  extract  the 
MTFs.  These  two  lines  generate  the  needed  inputs  for  the  Sensor  Perfomumce  modules 
which  compute  SNR  and  NURS.  The  AGC  option  is  used  to  avoid  detector  saturation. 

The  outputs  consist  of  plots  of  the  two  MTFs  and  ASCII  files  summarizing  SNR 
and  NIIRS  performance.  MTF  comparisons  to  the  GIQE  MTFs  are  shown  in  Figures  5-2 
and  5-3.  The  performance  metric  comparison  is  given  as  Table  5-2.  The  differences, 
particularly  in  the  MTF  curves,  are  attributed  to  roundoff  and  sparse  sampling  of  the 
comparison  data  firom  the  GIQE  documentation.  In  general,  the  results  compare  well. 

5.2  MTF  ANALYSIS 

The  second  example  is  an  illustration  of  the  individual  MTF  components  for  the 
GIQE  test  case.  The  workspace  is  depicted  in  Figure  5-4.  In  this  case,  there  are  parallel 
paths  for  generating  the  MTF  functions  (in  the  X  direction)  due  to  the  atmospheric  path, 
optics,  line-of-sight  motion,  and  detector.  Figure  5-5  provides  the  resulting  MTF  plots. 
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Table  5-1:  GIQE  Test  Case  Parameters 


Imaging  Scenario 

Altitude 

20  km 

Platform  velocity 

200  mJs 

Ground  range 

20  km 

Atmosphere 

Atmosphere  model 

Midlatitude  summer 

Haze  inodel 

Rural,  23  km  visibility 

Path  rQ 

80  cm 

Sun  zenith 

60  degrees 

Sun  azimuth 

90  degrees 

Multiple  scattering 

Yes 

Reflectance 

Target 

0.15 

Background 

0.07 

Optics 

Focal  length 

706.1  cm 

Diameter 

35.3  cm 

Obscuration 

0.32 

Spectral  band 

0.5  -  1.0  pm 

Transmission 

0.6 

Irregularity 

0.08  waves  at  0.63  pm 

Boundary  layer  turbulence 

0.08  waves  at  0.63  pm 

Environmental  aberrations 

0.08  waves  at  0.63  pm 

Defocus 

0.0127  cm 

Detector 

Dwell  time 

6.4  msec 

Size 

24  pm 

Pitch 

24  pm 

TDI 

None 

Aggregation 

None 

Full  well 

500,000  electrons 

Dark  current 

0.28  nA/cm^ 

Read  noise 

50  rms  electrons 

Quantum  efficiency 

0.4 

Digitization  levels 

12 

Line  of  Sight 

Pushbroom  drift 

3.4  prad  (y) 

Linear  drift 

1 .7  prad  (x  and  y) 

Jitter 

0.7  prad  (x  and  y) 

MTF  Compensation 

Kernel 

-0.0732  -0.3536  -0.0732 

-0.3536  2.7070  -0.3536 

-0.0732  -0.3536  -0.0732 

Noise  gain  2.8 
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Figure  5-2:  Comparison  of  Test  Case  MTFs  (X-axis) 
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Figure  5-3:  Comparison  of  Test  Case  MTFs  (Y-axis) 
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Table  5-2;  GIQE  Test  Metric  Comparison 


GIQE 

Documentation 

IBSM 

Example 

GSD 

3.8  inches 

3.79  inches 

RER 

0.57 

0.568 

H 

0.94 

0.930 

G 

2.8 

2.8 

Signal 

24,000  electrons 

22,600  electrons 

Noise 

312  rms  electrons 

304  rms  electrons 

SNR 

77 

74.36 

NIIRS 

7.6 

7.733 
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Figure  5-4:  Workspace  Corresponding  to  MTF  Analysis 
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Figure  5-6;  Workspace  Corresponding  to  Parametric  Performance  Loop 
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Figure  5-8:  Image  Quality  Versus  Ground  Range 
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Figure  5-9:  Workspace  for  Image  Based  Analysis 


Figure  5-11:  Output  Image  for  20  km  Ground  Range  Simulation 
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Table  5-3:  Sensor  Performance  at  20  km  Ground  Range 


Relative  Edge  Response 
RERx  =  0.396059 
RERy  =  0.377334 
RER  =  0.386583 

Edge  Height  Overshoot 
Hx  =  0.905863 
Hy  =  0.889775 
H  =  0.897783 

Ground  Sample  Distance 

GSDx  =  3.793512  inches 
GSDy  =  3.793512  inches 
GSD  =  3.793512  inches 

Signal  to  Noise  Ratio 

Tgtmean  =  138425.359375 
Tgtstdev  =  343.018219 
Bkg  mean  =  92088.546875 
Bkg  stdev  =  326.980682 
SNR  =  135.085571 

RIIRS  Rating  =  7.252930 
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Figure  5-14:  Output  Image  for  100  km  Ground  Range  Simulation 
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Figure  5-15:  Line  Response  Functions  (100  km) 
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Table  5-4:  Sensor  Performance  at  100  km  Ground  Range 


Relative  Edge  Response 
RERx  =  0.452482 
RERy  =  0.423539 
RER  =  0.437772 

Edge  Height  Overshoot 
Hx  =  0.903506 
Hy  =  0.893863 
H  =  0.898672 

Ground  Sample  Distance 

GSDx  =  13.740983  inches 
GSDy  =  13.740983  inches 
GSD  =  13.740983  inches 

Signal  to  Noise  Ratio 

Tgtmean  =  135575.078125 
Tgt  stdev  =  792.945740 
Bkgmean  =  93194.968750 
Bkg  stdev  =  948.609802 
SNR  =  53.446419 


NIIRS  Rating  =  5.563873 


6.0  SOFTWARE  OVERVIEW 


As  depicted  in  Figure  6-1,  the  EBSM  software  consists  of  primarily  three  functional 
layers  of  software:  a  Khoros  executive  layer  containing  file  I/O  and  graphical  user 
interface,  a  Khoros  library  function  layer  containing  functional  interface  between  executive 
layer  and  the  analytical  code,  and  the  sensor  modeling  library  containing  the  analytical 
modeling  code.  Numerical  Recipes  and  MODTRAN  are  used  for  analytical  computations 
and  atmospheric  modeling. 

6.1  KHOROS  EXECUTIVE  LAYER 

Table  6-1  summarizes  the  routines  contained  in  the  Khoros  executive  layer.  Each 
routine  is  a  UNIX  command  line  executable  function,  but  also  contains  the  appropriate 
code  to  run  within  Cantata.  This  additional  code  includes  the  graphical  user  interface  and 
on-line  documentation. 

6.2  KHOROS  LIBRARY  FUNCTION  LAYER 

The  routines  contained  in  the  Khoros  library  function  layer  are  associated  with  the 
executive  layer  functions  in  Table  6-1.  These  routines  are  C  functions  which  are  called  by 
Khoros  executive  functions.  The  majority  of  these  functions  contain  the  software  which 
loops  over  the  multiple  input  image  bands  and  calls  specific  analytical  function  to 
appropriately  process  each  image  band.  In  the  case  of  the  parametric  functions,  these 
functions  contain  module-specific  analytical  code  as  well. 

6.3  SENSOR  MODELING  LIBRARY 

Table  6-2  summarizes  the  routines  contained  in  the  sensor  modeling  library.  These 
routines  are  C  functions  which  form  the  analytical  modeling  basis  of  the  IBSM  software. 
These  routines  are  called  by  the  Khoros  library  functions  to  perform  the  majority  of  the 
physical  modeling  described  in  Section  3. 
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Table  6-1 :  Khoros  Executive  Layer  Routines 


Toolbox  Function  Name  Executive  Routine  Library  Function  Routine 


Atmosphere  Modtran  Input 
Path  Trans/Rad 
Turbulence  OTF 
Aero-Optic  OTF 

Optics  Diffraction  OTF 

Defocus  OTF 
Jitter  OTF 
Drift  OTF 
Wavefront  OTF 
User  OTF  (1-D) 

User  OTF  (2-D) 
Radiometry 

Detector  Detector  Size  OTF 

TDIOTF 
GTE  OTF 
Diffusion  OTF 
Detection 
Noise 

Quantization 

Sampling 

Nonuniformity 

Performance  Create  Spectra 
Create  MTF 
Sensor  Performance 
Exposure  Control 
Image  Quality 

Utilities  VlFF  to  IBSM 

IBSM  Info 
Transform 
Create  Plot  Data 
Create  Radiance  Image 
Ground/ Angle  Transform 


atmodtran 

atpatrra 

katmos_path 

atturbotf 

kotf_turb 

ataerotf 

kotf_aero 

opdiffotf 

kotf_diffr 

opdefotf 

kotf_blur 

opjittotf 

kotfjitter 

opdrifotf 

kotf_drift 

opwaveotf 

kotf_wave 

opuserotf 

kotf_user 

opusrotfZ 

kotf_user2d 

opradiom 

kradiometry 

desizeotf 

kotf_detsize 

detdiotf 

kotf_tdi 

decteotf 

kotf_cte 

dediffotf 

kotf_detdiff 

dedetect 

kdetection 

denoise 

knoise 

dequantiz 

kquantize 

desamplin 

ksampling 

denonunif 

knonunit 

pecrespec 

kspectra 

pecremtf 

kmtf 

pesensper 

kperf 

peexpctl 

kexp_cntrl 

peimgqual 

kqimage 

viff2ibsm 

ibsminfo 

utxform 

ktransform 

utcreplot 

utcreradi 

kradimg 

utgrdangl 

kgndang 
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Table  6-2:  Sensor  Modeling  Library  Routines 


mm 

Function 

Atmosphere 

atmos_path 

Apply  atmospheric  path  transmission  and  radiance  to  image 

otf_tiirb 

Generate  and  apply  path  turbulence  OTF  to  spatial  spectrum 

otf_aero 

Generate  and  apply  aero-optic  boundary  layer  OTF  to  spatial  spectrum 

atmos_i{) 

Compute  atmospheric  path  correlation  diameter 

atmos_cndata 

Compute  index  structure  profile  along  path 

modtran_path 

Compute  atmospheric  transmission  and  path  radiance  i 

modtran_rad 

Compute  solar  or  lunar  direction  and  diffuse  radiance 

;  Optics 

otf_diffr 

Generate  and  apply  aperture  diffraction  OTF  to  spatial  spectrum 

otf_blur 

Generate  and  apply  gaussian  blur  OTF  to  spatial  spectram 

otf Jitter 

Generate  and  apply  Mne-of-sight  jitter  OTF  to  spatial  spectrum 

otf_drift 

Generate  and  apply  line-of-sight  drift  OTF  to  spatial  spectrum 

otf_wave 

Generate  and  apply  wavefront  error  OTF  to  spatial  spectrum 

otf_user 

Generate  and  apply  1-D  user  defined  OTF  to  spatial  spectrum 

otf_user2d 

Generate  and  apply  2-D  user  defined  OTF  to  spatial  spectrum 

radiometry 

Perform  optical  system  radiometric  operations 

Detector 

detection 

Perform  detector  photoelectronic  conversion 

gauss_noise 

Apply  gaussian  distributed  noise  to  image 

shot_noise 

otf_detsize 

Generate  and  apply  detector  footprint  OTF  to  spatial  spectrum 

otf_detdiff 

Generate  and  apply  detector  diffusion  OTF  to  spatial  spectrum 

otf_tdi 

Generate  and  apply  time-delay -integrate  OTF  to  spatial  spectrum 

otf_cte 

Generate  and  apply  charge  transfer  inefficiency  to  spatial  spectrum 

sample 

Sample  image  based  on  detector  pitch 

quantize 

Quantize  image  based  on  scalar  truncation 

nonunif 

Apply  effects  of  gain  and/or  offset  nonuniformity 

Utilities 

transform 

Convert  between  image  and  spatial  spectrum  domains 

Miscellaneous 

copyhdr 

Copy  header  structure 

blackbody 

linint 

rect 

Compute  rect  ftinction 

sine 

Compute  sine  function 

tiri 
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